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^ ' The quantum relative entropy is frequently used as a distance measure between two quan- 

tum states, and inequalities relating it to other distance measures are important mathematical 
^ ■ 

tools in many areas of quantum information theory. We have derived many such inequalities 



in previous work. The present paper is a follow-up on this, and provides a sharp upper bound 

on the relative entropy in terms of the trace norm distance and of the smallest eigenvalues of 

^ ■ both states concerned. The result obtained here is more general than the corresponding one 

> . 

^ , from our previous work. As a corollary, we obtain a sharp upper bound on the regularised 

vn 

\Q ' relative entropy introduced by Lendi, Farhadmotamed and van Wonderen. 

(N ■ 

o 
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I. INTRODUCTION 

The quantum relative entropy of states of quantum systems is a measure of how well one 
quantum state can be operationally distinguished from another and quantifies the extent to which 
one hypothesis p differs from an alternative hypothesis a in the sense of quantum hypothesis 



testing DSLlZLIS, 



Uh . It is defined as 

S{p\\a) = Trp(logp - log a) 
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for states p and a [11011 whenever the support of p is contained in the support of a, and is defined 
to be +00 otherwise. 

In [130 we presented a number of inequalities relating the quantum relative entropy, used as a 
distance measure, to the trace norm distance. The present paper is a follow-up on this work, and 
concems a sharp upper bound on the relative entropy S{p\\o) in terms of the trace norm distance 
\\p — cr||i/2, when the smallest eigenvalues of p and a are given. The need for these smallest 
eigenvalues stems from the fact that the relative entropy can be infinite when the kemel of a is not 
contained in the kemel of p. Rastegin obtained similar inequalities for the relative g-entropy [|9L 

As a special case of the main theorem proven here (Theorem [1), we reobtain Theorem 6 of [(SO. 
The proof given in [|3|] was incorrect, and the proof we give here serves as a correction and at the 
same time as a generalisation. 

We also obtain an upper bound (Corollary |2]) on the so-called regularised relative entropy, 
introduced by Lendi et. al. [6] as one possible means to circumvent the problem of infinities of the 
ordinary relative entropy. The regularised relative entropy is defined as 

R{p\\a)=CdS{p + l\\a + l), 

where is a certain normalisation constant depending on d, the dimension of state space. Note 
that 5* (p + I| Ic + I) < log 2, with equality for orthogonal pure states, hence one could also choose 
the normalisation constant to be 1/ log 2. 

In the following section, we introduce the notations and mathematical tools necessary for the 
proofs. Then, in Section Hill we derive an integral representation for the relative entropy between 
non-normalised states (i.e. positive definite matrices), which is also essential for the proofs. An 
upper bound on the relative entropy for non-normalised states is derived in Section |lVl which 
is then used in Section |V] to obtain the promised sharp upper bound on the relative entropy for 
normalised states. 



II. NOTATIONS AND PRELIMINARIES 



In this paper we will work exclusively in finite dimensional Hilbert spaces, so that quantum 
states can be represented by positive semidefinite matrices. We denote the identity matrix by I, 
and scalar matrices al simply by a (for a G R) when no confusion can arise. The matrix norms 
II ■ 111 and 1 1 • I loo are the trace norm and operator norm, respectively. 
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The von Neumann entropy can be defined for positive definite matrices as 



S{A) = -TrAlogA, 



(1) 



wliich coincides with the usual definition for density matrices. Furthemore, we define S{0) = 0. 
Likewise, the quantum relative entropy can be defined for positive definite matrices A and B as 



S{A\\B) = TrAilogA - log 5). 



(2) 



This definition still holds for positive semidefinite A and B provided the support of B is contained 
in the support of B; otherwise one defines ^(Al = +oo. The quantum relative entropy satisfies 
the scaling property 

S{aA\\aB) = aS{A\\B),a> 0. (3) 

The logarithm appearing in ([T) and (|2]) is the matrix logarithm. For x > 0, we have the 
following integral representation for the scalar logarithm: 

1 1 



log a; 



ds 



IQ \1 + s X + s 
and for A > we define the matrix logarithm as 

1 



(4) 



log A = / ds 



-{A + s)-' 



(5) 



The methods we will use require the derivative of the matrix logarithm; see also |2|]. From 
the integral representation of the logarithm we get, for A > 0, 



d_ 

di 



poo 

\og{A + tA)= ds {A + s)-^A{A + s)-\ 
I Jo 

As is customary, we define the following linear map for A > 0: 

POO 

Ta{A)= ds{A + s)-^A{A + s)-\ 
Jo 



Thus 



d_ 

dt 



log(A + tA) = rA(A). 



(6) 



(7) 



t=o 



Again, ^ and (|7]) are also valid for A > provided ker A C ker A. 

From the integral representation of T it follows that, for any A > 0,Ta preserves the positive 
semidefinite order: ifX<Y, then TaIX) <rA{Y). 
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For X > 0, the integral ds x/{x + s)^ is equal to 1. Hence, for A > 0, 

poo 

rA{A)= / ds{A + s)-^ A{A + s)-^ = 1. (8) 

An argument that we will use frequently is the special structure of the Jordan decomposition of 
a traceless Hermitian matrix. Let A be Hermitian, and Tr A = 0. The Jordan decomposition of A 
is given by A = A+ — A_, where A+ and A_ are positive semidefinite and mutually orthogonal, 
i.e. A+A_ = 0. We have Tr A = Tr A+ - Tr A_, hence Tr A+ = Tr A_. Thus 

||A||i = TrA+ + TrA_ = 2TrA+. (9) 

It will also be clear that 1 1 A| |oo is bounded above by Tr A+, and thus 

||A||oo < ||A||i/2, (10) 

whenever A is traceless and Hermitian. 

III. AN INTEGRAL REPRESENTATION OF THE RELATIVE ENTROPY 

In this section we derive an integral representation of the quantum relative entropy for non- 
normalised states, 

S{A\\B) = Tr v4(logA - log 5), 
in terms of a differentiable path s C(s), where C(0) = A, C(l) = B and C(s) > 0. 

Lemma 1 Let A > and B > 0. Let < s < 1 and let s ^ C{s)be a continuous, differentiable 
path joining A and B (that is, C(0) = A and C(l) = B) and for all s G (0, 1), C{s) > 0. Then 
the relative entropy S{A\\B) has the following integral representation: 

/•I f]n 

S(A\\B) =Ti( A- B) + ds Ti— (log B -log C(s)). (11) 

./n ds 



In particular, if the path is linear, C{s) = (1 — s)A + sB, then (fTTI) becomes 

S{A\\B) = Tt{A- B) + Tt{B - A)\ogB - [ ds Tt{B - A)\og{A + s{B - A)). (12) 

Jo 
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Proof. First we rewrite S'(A| as 

S{A\\B) = TTA{\ogA-\ogB) 

= Tt{B - A) log B + {S{B) - S (A)). 

Both terms can be written as integrals. For the first term we have 

'1 , dC 



Tt(B - A)\ogB = Tt ds —log B. 

Jo ds 



The second term can be written as: 

S{B) - S{A) = -Ti{B - A) - / ds Tr — logC(s). 

Jo ds 

This can be shown as follows. Let f{x) = —xlogx be the function defining the von Neumann 
entropy S{A) = Tr f{A). As f (x) = —1 — logs, we have, for < s < 1, 

f/iCis)) ^ ijrfids)) 

= Trr(C^(.))f 

^ dC ^ dC ^ , 
= -Tr — -Tr — logC s . 

ds ds 

Integrating over s in the interval [0, 1] yields, indeed, 

S{B)-S{A) = S{C{1)) - S{C{0)) 

ds^S{C{s)) 
ds 

ds Tr 



/ c^s Tr^logC(s) 
Jo ds 
/•I 

-Ti{B-A)- rfs Tr — logC(s). 
Jo ds 



Finally, adding the two integral representations yields (fTT)) . □ 



IV. UPPER BOUND ON THE RELATIVE ENTROPY FOR NON-NORMALISED STATES 

In this section, we prove the main technical proposition (Proposition [B from which the 
promised sharp bound will follow. The proposition provides an upper bound on the relative en- 
tropy for non-normalised states A and B with equal trace, in terms of the trace norm distance T 
between A and B, and of the minimal eigenvalues of A and B. 
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We will denote the lowest eigenvalue of A by a, and the lowest eigenvalue of B by /3. First 
we establish the allowed range of T in terms of ot and /3. It turns out that the trace norm distance 
between A and B cannot be smaller than |a — 

Lemma 2 Let A, B be positive semidefinite n x n matrices with Tr A = Tr B, and Amin(A) = a 
andX^i^{B) = /3. ThenT = \ \A- B\\i/2 > \a - P\. 

Proof. We assume first that a > (3. Let A := A — B have Jordan decomposition A = A+ — A_. 
Since Tr A = Tr B, we have Tr A = 0, hence 1 1 A - fi| 1 1 = 2 Tr A+. 

Denoting the vector of eigenvalues sorted in non-increasing order by the symbol A-'-, we then 
clearly have 

= 2TrA+ > 2Aj(A+) = 2X\{A-B). 

Now, by Lidskii's Theorem (e.g. inequality (III. 12) in [4]), for all Hermitian A and B, the vector 
\^{A) — \^{B) is majorised by the vector \^(A — B). In particular, 

\\{A -B)> max{Aj(A) - \]{B)} > \i{A) - Xi{B). 

By the hypothesis of the lemma, the last expression is equal to a — (3. 

Hence we have shown that | |A — -B| |i > 2(a — /3) when a — (3 > 0. When a — /3 < we can 
just swap the roles of A and B and obtain | |y4 — i?| |i > 2(/3 — a). □ 

Because of the scaling property (|3]) we can restrict ourselves to the case (3 = 1. 

Proposition 1 Let A,B be positive definite with TrA = Tri?, Amin(^) = O-, Amin(-B) = 1 and 
T := \ \A — B\\i/2. Then T > | a — 1 1, and Then, for a > 0, 

S{A\\B) < (l + r)log(l + T)-«log(l+T/«), (13) 

where a —a log(l + T/ a) is monotone decreasing, and —a log(l + T/ a) =: Ofor a = 0. 
Moreover, quality can be achieved for any allowed values of a and T. 

The proof relies on the following lemma: 

Lemma 3 Let a and b be two positive definite matrices with Tr a = Tr b, and let t = \ \b — a\\i/2. 
Ifa>'y, with 7 a non-negative scalar, then 

%{b-a)<^ (14) 
1 + t 
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Proof. Let 5 = h — a, which is Hermitian with trace equal to and trace norm equal to 2t. Thus, 
by (flOl) . ||5||oo < t, ov 5 < t. We also have ^7 < ta. Combining the two inequalities yields 

'yS < ta = t{b — 5). Hence, 

b-a = 6< —^b. 

~ j + t 

Since the operator Y H- Tx{Y) is order-preserving for X > 0, applying this operator to both sides 
yields 

%{b-a) < -^Mb) ^ 



7+t 7+^ 

□ 



Proof of Proposition\l\ We consider strictly positive a first. Let us apply Lemma|3]to the case 
a = A and b = A + x{B — A), with A and B the matrices of the proposition and < a; < L Let 
A = B — A. Then 5 = xA, t = xT and 7 = a. By the lemma, we then have (after dividing by x) 

rA+.A(A) < . (15) 

a + xl 

Likewise, by setting a = B , b = B + (1 — x){A — B) and 7 = 1, we get 

rB+(i-.)(-A)(-A) < Y-^jr^- 

Noting that B — (1 — x)A = xB + (1 — x)A = A + xA, this yields the lower bound 

r....(A) > j^^. (16) 

Again we exploit the Jordan decomposition of A, A = A_|_ — A_ with A_|_, A_ > and Tr A+ = 
Tr A_ = T, due to the facts that Tr A = and 1 1 A| |i = 2T. Combining this with (O and (fT6l) . 
and exploiting the fact that for X > 0,Y < y implies Tr XY < j/ Tr X, we get 

TrArA+,A(A) = TrA+rA+xA(A) -TrA_rA+.A(A) 

T -T 



< T 



a + xT l + (l-x)T^ 
Now let s be a scalar, < s < L Integrating the previous inequality over x from s to 1 yields 

Tr A(log(A + A) - log(A + sA)) < T(log(a + T) - log(a + sT) + log(l + (1 - s)T)). 

Integrating a second time, now over s from to 1, yields: 

[ ds TrA(log5-log(A + sA)) < (1 + T) log(l + T) + a(loga - log(a + T)). 
Jo 
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To finish the proof, we define the rectilinear path C{s) = sB + {1 — s)A, for which dC/ds = 
B — A = A, and use Lemma[T]to show that the left-hand side is just S{A\\B). 

The strict positivity of a is required to satisfy the conditions of Lemma |3] However, by conti- 
nuity of the relative entropy in its first argument, the bound must be valid for a = too. In the 
limit of a tending to 0, a;(log a — log(a; + T)) goes to 0. 

Finally, we show that equality can be obtained for every allowed value of T and a. Indeed, 
taking 




A = \ and 5 = 

y a J 

satisfies all the requirements of the proposition and yields equality in (fT3]) . □ 




V. SHARP UPPER BOUNDS ON THE RELATIVE ENTROPY AND REGULARISED 

RELATIVE ENTROPY 

Proposition \T\ allows us to derive an upper bound on the ordinary relative entropy between 
density operators p and a when the eigenvalues of p and a are bounded below by the values a and 
l3, respectively. 

Theorem 1 Consider density matrices p and a, with smallest eigenvalues Amin(p) = « and 
Amm(o") = P- Then T := \ \p — o"||i/2 > |a; — /3| and, for a, (3 > 0, 

S{p\W) <{f3 + T) log(l + T/f3) - a log(l + T/a), (17) 

and, in the limit a — )■ 0, 

S{p\\a)<{f3 + T)\ogil + T/f3). (18) 

Proof. We use the scaling property and Proposition [1] with A = p/ (3 and B = a / (3. The formula 
of Proposition[T]can be taken over completely by replacing a by T by T/ (3, and multiplying 
the right-hand side of each bound by /3. □ 



Note that, because of the extra normalisation requirement Tr p = Tr cr = 1, equality can now 
only be achieved for states of dimension at least 3. 

If a is not specified, we must take the maximum of (/3 + T) log(l + T / (3) — alog(l + T/a) 
over all allowed values of a, with /3 and T kept fixed. In doing so we retrieve Theorem 6 of DSD. 
The proof given here supplants the incorrect proof in the published version of Jsj]. 
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Corollary 1 Consider density matrices p and a, where a has smallest eigenvalue Amin(o") = /9. 
LetT := ||p- a||i/2. IfT < (3 

S{p\\a) < (/3 + T) log(l + T//3) + (/3 - T) log(l - T//3), (19) 

and ifT>(3, 

S{p\\a)<{P + T)\og{l + T/P). (20) 

Proof. Let Amin(p) = a. To find an upper bound on ^(Alli?) in the case that a is not specified, 
we maximise the bound (flTI) over all allowed a. Because of Lemma [2l T > |q; — Hence, the 
range of a is [max(0, j3 — T), (3 + T]. The quantity to be maximised is — alog(l + T/a), which is 
monotonously decreasing in a. Thus, its maximum is attained for the minimally allowed a, being 
max(0, f3 — T). The two cases of the corollary follow. □ 



We immediately obtain an upper bound on the regularised relative entropy in terms of the trace 
norm distance. 

Corollary 2 For d-dimensional density matrices p and a, with smallest eigenvalues Xmm{p) = « 
and Amm(o") = cind T := \ \p — cr\\i/2, 

R{p\\a) := CdS{p + I\\a + l) (21) 

< Q + 1 + T) log(l + T/(/3 + 1)) - (« + 1) log(l + T/{a + 1))) (22) 

< QTIog(l + r). (23) 

From dimension 3 onwards, inequality d2?]) is sharp. Equality can be achieved for any allowed 
value ofT, by the diagonal states p = Diag(l — t, t, 0) and a = Diag(l — t, 0, t), where t can be 
any number between and 1. 

Proof. Upper bound (|22]) is a straightforward application of Theorem [T] (apart from a rescaling 
of p + I and (7 + 1, which has no effect on the bound itself). When no information about a and 
(3 is known one can use the bound (l23l) which follows by exploiting the fact that both (/3 + 1 + 

T)log(l + r/(/3 + 1)) and —(a + l)log(l + T/{a + 1)) are monotonically decreasing, hence 
expression (|22)) is maximal for a = /3 = 0. □ 
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